Spectra of sparse regular graphs with loops 
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We derive exact equations that determine the spectra of undirected and directed sparsely con- 
nected regular graphs containing loops of arbitrary length. The implications of our results to the 
structural and dynamical properties of networks are discussed by showing how loops influence the 
size of the spectral gap and the propensity for synchronization. Analytical formulas for the spectrum 
are obtained for specific length of the loops. 
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Networks have emerged as a unified framework to 
study complex problems in disciplines ranging from 
physics, biology, information theory, chemistry to tech- 
nological and social sciences [l|. Some notable exam- 
ples are the backbone of the Internet, which consists of 
routers connected by physical links, and the metabolism 
of the cell, represented as a tripartite network of metabo- 
lites, reactions and enzymes. As many seemingly un- 
related problems are modeled by networks, it is crucial 
to understand how the topology of networks influences 
the processes governed on them. The efficiency of error- 
correcting codes and communication networks [3, |3[ , the 
propensity for synchronization [J,|5[ and the mixing times 
of search algorithms [6], among others, are unveiled from 
a spectral analysis, i.e. from a study of the adjacency 
matrix and the Laplacian of the network [7| . 

A widespread theoretical approach consists in mod- 
eling real-world networks by sparsely connected random 
graphs [8| , which have a local tree- like structure and thus 
a small number of short loops. The Kesten-McKay law 
[9| for the spectrum of sparse regular graphs is a rare 
example of an analytical solution for the spectral density 
and shows that regular graphs have a large spectral gap, 
implying many optimal structural properties [3[. Spec- 
tral analyzes of irregular sparse random graphs such as 
Erdos-Renyi graphs [lO|, [ll[ , scale- free graphs and small- 
world systems have recently been considered JI2|. 

However, Bravais lattices and real- world networks, 
such as the Internet and metabolic networks, exhibit a 
large number of undirected and directed short loops [iSj , 
while other examples like power grids and neural net- 
works are under-short looped, i.e. they have less short 
loop s than their corresponding random graph models 
[14{ . To study the effect of loops on structural and dy- 
namical properties of complex networks we consider the 
Husimi graph |l5| (also called Husimi cactus), which is 
built out of randomly drawn short loops. The Husimi 
graph allows for a detailed spectral analysis as a function 
of the loop length, due to its exactly solvable nature. To 
our knowledge, results for the spectrum of graphs with 
loops are scarce, apart from the analytical formula for 
the triangular Husimi graph [16|. 



In this letter we present a systematic study of the spec- 
tra of regular Husimi graphs containing undirected or 
directed edges, going beyond previous studies on local 
tree-like networks without short loops. We analyze the 
influence of loops on some important network properties: 
the size of the spectral gap and the stability of synchro- 
nized states. The simplicity and exactness of our equa- 
tions, confirmed by direct diagonalization methods, leads 
to accurate results for arbitrary loop lengths and allows 
for an extension of the Kesten-McKay law to triangu- 
lar and square undirected Husimi graphs as well as to 
directed regular graphs without short loops. 
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FIG. 1. Local tree-like structure of a (3, 2)-directed and a 
(4, 2)-undirected regular Husimi graph. The average path 
length between two nodes is of order 0(\nN). 



Sparse regular graphs with loops We consider the en- 
semble of (£, fc)-regular (un)directed Husimi graphs con- 
taining N vertices or nodes. Each vertex is incident to 
k > 1 loops composed of I nodes, with k and I indepen- 
dent of N . The indegree and outdegree of any node are 
equal to each other, and given by 2k or k in the case of 
undirected or directed Husimi graphs, respectively. For 
N —i' oo the graphs have a local tree-like structure on the 
level of loops, illustrated in figure [1] for triangular {£ = 3) 
and square {£ — 4) Husimi graphs. The model allows 
to interpolate between i = 2 and £ — >■ oo, both cases 
representing situations where short loops are absent. 

We study the spectral density of the N x N adjacency 
matrix J for N -^ co, which is trivially related to the 



spectrum of the Laplacian matrix in the case of regular 
graphs. The matrix element Jij assumes 1 if there is 
a directed edge from node i to node j, and zero oth- 
erwise. Denoting the eigenvalues of a given instance 
of J as {Xi}i=i,...,N^ the spectral density is defined as 
p(A) = lim^f^oo -^ X]i=i ^{^ ~ ^i)- The matrix J is sym- 



metric or asymmetric depending whether the graph is 
undirected or directed, respectively. The eigenvalues are 
real in the former case and complex in the latter. The 
local tree-like structure shown in figure [T] allows to cal- 
culate p{X) exactly for iV -> oo. 

Spectra of undirected Husimi graphs The resolvent 
G(z) of J is defined through G(z) = (z — J)~^, 
where the complex variable z = X — ie contains a 
regularizer e. The spectrum is extracted from the 
diagonal components of G{z) according to p{X) = 
limjv^oo,e^o+ (7riV)~-^ImTrG(A — ie). 

Due to the absence of disorder, a closed expression can 
be derived for the diagonal elements Gii{z) = G{z), V i. 
For graphs without short loops, either one writes Gu{z) 
as the variance of a Gaussian function and uses the cavity 
method (or the rephca method) [lO[, or one uses repeat- 
edly the Schur- complement formula and the local conver- 
gence of graphs to a tree [ill . Generalizing these meth- 
ods to Husimi graphs 17[, we have derived the following 
equation for p{X) 



p(X) = — lini Imfz 



kGf, 



(1) 



where G, solves 



Gs — . 



(z-(k- l)G,)l,_i - U-i - L^i h , (2) 



with l£_i the (£— l)x (^—1) identity matrix, L^-i the {£— 
l)-dimensional matrix with elements [L^_i]ij — Sij^i, 
and J^ the (€—l)-diniensional vector Jj = (1 ... 1). 
For £ = 2, the solution of eq. ([2]) yields the Kesten-McKay 
law [9|, where p{X) takes the form 



P(A) 



k y/i{k-l)-X^ 

2^ P- A2 



(3) 



for |A| < 2\/k — 1, and zero otherwise. For i? > 2, we 
have inverted the matrix in eq. ([2]) [19|, leading to 



G, 



2ae-2 



(4) 



main results of our work, allowing to compute exactly 
the spectrum for increasing values of i. 

For ^ = 3 we recover the analytical expression for p{X) 
presented in [16|. For € = 4 eq. (U) becomes a cubic 
polynomial with discriminant 



DiX)^-^X'~^{e-22k- 
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3(^-2)3. (5) 



Defining the functions s± (A) 
and '7±(A) — o^ 
graphs reads 



9X{k + l)-X^±9y^D{X) 



sj ± s_ , the spectrum of square Husimi 



P(A) 



6VSk{k-l)q^{X) 



2{k-3)X + kq+{X) +37rfc2g?.(A) 



(6) 



for 13(A) > 0, and p(A) = otherwise. The edges of p(A) 
solve the equation D{X) = 0. The analytic expression for 
some higher values of £ is given elsewhere [l7| . 

In figure [5] we compare direct diagonalization results 
of finite matrices with the solution to eq. ((4]) , for A: = 2 
and several values of £. The agreement is excellent, fol- 
lowing from the exactness of eq. ([4]) for A^ — >■ 00. When 
rescaling the matrix elements Jij — > Jij /y'2k — 1 we find 
analytically the convergence of p(A) to the Wigner semi- 
circle law for fc — > 00 and arbitrary £ ,18]. Interestingly, 
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FIG. 2. Spectrum of (£, k) undirected Husimi graphs with 
k — 2 and Jij — ^ Jij/\/2k — 1, obtained by solving eqs. ((!]) 
and Q. The symbols are direct diagonalization results of 
adjacency matrices of size A'^ = lO*. The spectrum of the two- 
dimensional square Bravais lattice and the Kesten-McKay law 
are presented for comparison. 



where the coefficients 02, . . . a^-i follow from the recur- 
rence relation a^ — aiai-i — cki_2, with aa — 1 and 
«! — z — {k — l)Gs- Equation Q leads to a polyno- 
mial in the variable Gs and can be solved analytically for 
smaller values of £, extending the Kesten-McKay law to 
regular graphs containing short loops. For larger values 
of £ a straightforward numerical solution can be obtained, 
giving sharp results for p{X). Equation Q is one of the 



the spectrum of a square Husimi graph exhibits a strik- 
ing similarity with the spectrum of the two-dimensional 
square Bravais lattice [20|, with the appearance of a 
power-law singularity at A = with p{X) ^ |A|~"'^/^. In 
the case of the square Bravais lattice, the spectral density 
contains a Van Hove singularity at A = 0, with a logarith- 
mic divergence. Our results thus suggest that Van Hove 
singularities are related to the local neighborhoods and 



not to the dimensional nature of lattices [20|. For ^ — >• oo, 
the spectrum converges to the Kesten-McKay law with 
degree 2fc @, as illustrated in figure [2] for £ = 10. There- 
fore, loops composed of ten nodes can be neglected and 
the graph can be considered locally tree-like (lCllll|. 

Spectra of directed Husimi graphs In the case of di- 
rected Husimi graphs, the density of states p{X) at a 
certain point A = x + iy oi the complex plane can 
be written as p(A) = limAr^oo(-^7r)^^9*TrG(A), where 

5* = i (^ + i-§^\ and G(A) = (A - J)-\ The opera- 
tion (•)* denotes complex conjugation. Due to the non- 
analytic behavior of Ga (A) in the complex plane 12111 . it 
is convenient to define the 2N x 2N block matrix |22i 



He (A) 



-i(A* 



-i{X 

fT-N 



(7) 



The NxN lower-left block of limg^g+ H~^ (A) is precisely 
the matrix G(A). Thus, the problem reduces to cal- 
culating the matrix elements Gj{X,e) = [H7^(A)] . 
(j — 1, . . . ,iV), from which the spectrum is determined 
according to p(A) = 
By representing 



■ limn 



^N 



as a Gaussian integral 



one can generalize the cavity method, as developed for 
sparse non-Hermitian random matrices (22|, to calculate 
the spectrum of directed Husimi graphs [17[ . Due to the 
absence of disorder we have that Gj{X, e) = 5(A, e), V j, 
and p(A) is given by 



p(A) = — lima*[S,(A) 



fcG 



-4J21 



(8) 



where Se(A) = [el2 ~ i (xax — ycTy)] and {ax,cry) are 
Pauli matrices. For i > 2, the two-dimensional matrix 
Ga solves the equation 



G. = 



(S.(A) 



iJ-S)!^/, 



-(fc-l)GA)®I/-l 

1 -1 



(9) 



where J^ is the 2 x 2{£ — 1) block matrix J^ = 
(J ... J^), with J = \{ax + ifJy). The derivative 
of eq. (HI yields an equation in d*GA, which has to be 
solved together with ^ to find p{X). Equation dH) al- 
lows to derive sharp numerical results for the spectrum 
of directed Husimi graphs as a function of £. 

In figure 13] we present the spectrum p(A) for £ = 3 and 
k — 2, comparing the solution to eqs. ([8][9]) with direct 
diagonalization results. The agreement is excellent. A 
prominent feature of p{X) is the £-fold rotational symme- 
try, due to the transformation properties of G^ under 
rotations of 27r/£. By rescaling Jij — >■ Jij/^/k — 1, we 
find analytically the convergence of p(A ) to Girko's cir- 
cular law for fc — >■ 00 and arbitrary £ [lg| . 

Analogously to undirected Husimi graphs, p(A) con- 
verges to the spectrum of a directed regular graph with- 
out short loops for £ — > 00. In this case, we find a re- 
markable extension of the Kesten-McKay law, Eq. ([3]), 
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FIG. 3. Spectrum of directed Husimi graphs with ^ = 3 and 
k — 2, obtained from eqs. (|8I9|I . Inset (a) shows three cuts 
along the real direction (red curves), together with direct di- 
agonalization results (symbols) obtained from an ensemble of 
3 X 10* matrices of size A'' = 10^ . Inset (b) shows theoretical 
results for the boundary of p{X) for £ = 3 and £ — 6 (red 
curves) . The number of corners in each boundary is equal to 
the value of £ and the blue dashed curve corresponds to the 
circle |A|^ = fc, for ^ — >■ 00. For comparison, direct diagonal- 
ization results are also shown in grey scale for £ = 3. 



to directed graphs, where p(A) takes the form 



P(A) 



TT Vfc^-|A|^ 



(10) 



for |Ap < k, and zero otherwise. A comparable equation 
appeared in [23|, but with a different support of p{X). 

In inset (b) of figure [3] we plot the boundary of p{X) 
for k — 2 and increasing values of ^. In accordance with 
eq. (fTO|) . the boundary converges to the circle |Ap = k in 
the limit ^ — >■ 00. For £ = 10 we have obtained numer- 
ically that p(A) is given approximately by eq. pH)) and 
the graph becomes locally tree-like 22 1. 

Structural and dynamical properties Let us order the 
eigenvalues of a regular undirected Husimi graph as Ai < 
A2 < • • • < Ajv, where Xm = 2k. The spectral gap g and 
the eigenratio Q are, respectively, defined by g = (Ajv — 
AAr_i)/2A: andQ = (Aat — Ai)/(AAr — A^v-i). Analogously, 
for regular directed Husimi graphs, the eigenvalues can 
be ordered according to their real parts ReAi < ReA2 < 
• • • < RcAat, with ReAjv = k. In this case, the spectral 
gap g and the eigenratio Q are given hy g = (ReAw — 
ReAAr_i)/A: and Q = (RcAat — ReAi)/(ReAAr — RcAat-i). 

The spectral gap g controls the speed of convergence to 
the stationary state of diffusion processes on the graph 
1]. Designing communication networks with a large g 
is known to be important due to improved robustness 
and communication properties p, l3| , for undirected net- 
works. The eigenratio Q measures the propensity for 



synchronization in networks of oscillators [J, l5| . A lin- 
ear stability analysis shows that synchronized states are 
more stable for smaller values of Q. 

Figure S] depicts g and Q as functions of £ for reg- 
ular Husimi graphs, showing that g increases while Q 
decreases for increasing values of £. For undirected 
Husimi graphs, g and Q converge, respectively, to (k — 
\/2k — l)/k and 2k/{k — \/2k — 1) as £ — ;> oo, consis- 
tent with the^Alon-Boppana bound for the second largest 
eigenvalue [24| . For directed Husimi graphs g and Q con- 
verge to (fc — vk)/k and 2fc/(fc — yk), respectively. In 
summary, short loops have a negative influence on the 
synchronization properties and on the size of the spectral 
gap, which is more pronounced at low connectivities. 
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FIG. 4. Spectral gap g and eigenratio Q of Husimi graphs as 
functions of £ for different values of k, with the asymptotic 
behavior for £ — ^ oo indicated by solid lines. 

Conclusions We have determined the spectrum of 
sparse regular random graphs with short loops through a 
set of exact equations, including extensions of the Kesten- 
McKay law to triangular and square undirected Husimi 
graphs as well as to directed regular graphs without short 
loops. We find that short loops in directed and undi- 
rected networks have a negative influence on the stability 
of synchronized states, they also worsen the communica- 
tion properties due to a decrease of the spectral gap. 
Our spectral results make the absence of loops in net- 
work construction a ppa rent [Sl , while neural networks are 
under-short looped (lj| . For the square Husimi graph we 
recover a singularity at the origin, which is also present 
in a square Bravais lattice. Overall, we find that the 
spectra of Bravais lattices are similar to the spectra of 
Husimi graphs with suitable neighborhoods, indicating 
that Husimi graphs serve as good toy models for Bra- 
vais lattices. Our results on spectra of sparse random 
matrices are of wide interest to diverse fields including 
the study of Markov chains [25], dynamics of spin-glasses 
[26|, etc. Since our work is mainly based upon the cavity 
method, it allows for an extension to e.g. irregular graphs 
with loops 10] and eigenvector localization studies [27 [. 
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